APPLICATION 
FOR 

UNITED STATES LETTER PATENT 



TO THE COMMISSIONER OF PATENTS AND TRADEMARKS: 

BE IT KNOWN, that I, Edward T. Bullister have invented a certain 
new and useful 

IMPROVED MOUSE AND TRACKBALL WITH OPTIMAL 
MEASUREMENT OPTICS 

of which the following is a specification: 



35 





25 



Applicant : 



Edward T. Bullister 



For : 



Improved Two- and Three-Dimensional Trackball 



with Enhanced Measurement Optics. 



3 0 This is a continuation-in-part of Ser. Nr. 08/558,7 1 0, filed 1 1/ 1 6/95, which was a 



continuation-in-part of Ser. Nr. 08/337,979, Filed 1 1/14/94, now U.S. Patent 5,751,275. 



35f This invention relates to a pointing device providing an 

Lj=f interface between a user and a computer for the input of two- and 

. O three-dimensional spatial coordinates, and to a method of 

O measuring rotations from the sensing ball and transforming them 

= into rotations about standard Cartesian coordinates. 



Tracking devices such as trackballs and mice are used in 
modern computer systems for a variety of purposes. A user can 
45 use them to tell a computer to move a cursor on a computer 

display. The ability to control a cursor is an integral part of 
the graphical user interfaces (GUIs) common in modern window- 
based computing systems . 



Background Field of Invention 



Background of the Invention 
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5 Trackballs are also used to input spatial translational and 

rotational coordinates into computer systems. This is commonly 
done in drafting and computer-aided-design packages. In these 
applications packages, the motion of the pointing device is used 
to define corresponding locations in a coordinate system in the 
10 applications package. 

The physical design of a typical trackball is described in 
U.S. patent No. 5,122,654 to Kanas Koh and Josef Bismanovsky, 
issued on 06/16/92. In the description of a trackballs provided 
below, all rotations and orientations are with respect to a 
15 sphere coextensive with the surface of a ball and fixed with 
y3 respect to a trackball housing. 

fy A ball is enclosed within a housing. A portion of one 

iy hemisphere of the ball is exposed to be rolled by a user's hand 
jn or finger (s). Two sensors mounted on a horizontal circuit board 
2£k sense the ball rotation and generate signals that correspond to 
the rotation and communicate them to a computer. Each sensor 
^ contains a cylindrical roller which contacts the ball in a small 
w area about a nominal, centralized contact point. The rollers 1 

axes are mutually orthogonal and parallel to the circuit board. 
25 The rollers contact the sphere in the bottom hemisphere (below 
the equator) , and roll along great circles of the sphere 
orthogonal to the equator (meridians) . These typical circuit 
board mounted sensors measure ball rotations about axes parallel 
to the circuit board but do not measure rotation about the axis 
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perpendicular to 



the cir 



cuit board. 



Some cursor 



control 



devices have optically tracked the 



translation with 



regular 



uniform patterns based on Cartesian 



(x-y) coordinates on flat mouse pads. However, Cartesian or 
spherical coordinates do not provide a regular, uniform pattern 

10 on a sphere. As a result, optical measurements on the spherical 
trackballs resort to tracking of random patterns on the ball 
surface. There is a need for a regular, well-defined pattern on 
a spherical to enable accurate, repeatable measurement of ball 
rotations in cursor control devices such as mice and trackballs. 

15. It is usually desirable in a mouse or trackball to have as 



ip large a ball as possible. A larger ball in a mouse can smoothly 
ry roll over dirt or surface irregularities which may cause a 
j3 smaller ball to become stuck. A larger ball in a trackball gives 
fp more control to the user. However, the location of the optical 

pick-up element can restrict the size of the ball. There is 
L^t therefore a need for a method to maximize the diameter of the 

ball with respect to the space available for the mouse or 
^ trackball. 

25 Trackballs are preferred over mice in portable computers 

because they can be built into the portable computer and need not 
translate relative to any fixed surface. Trackballs do not 
require the open flat surface over which a mouse must move. 



Often, an undesirably bulky and protruding trackball 



mount 
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5 is the best that manufacturers can achieve and illustrates the 

difficulties that have been encountered in locating the trackball 
in portable computers. In other designs the trackball must be 
detached or retracted within the computer for transport. In 
typical transportable trackballs, a retainer ring (which must be 
10 removable for cleaning the ball) leaves less than one half (one 
hemisphere) of the ball surface exposed. Furthermore, size 
constraints imposed in compact portable computer designs limit 
the size of the ball itself. The limited exposed area of these 
small balls limits accuracy and results in poor ergonomics. 
15 In the current art, the specification of three-dimensional 

yy (3-D) coordinates, and, in particular, the specification of 3-D 
ry rotational coordinates, can be extremely difficult. Several 

•J3 approaches have been developed, each of which has inherent 

r*~i 

m problems. 

In a first approach, a three-axis trackball is described in 
Wl the article "Tablet-based Valuators that Provide One, Two, or 

Three Degrees of Freedom", by K. B. Evans, et. al . in Computer 
ffl Graphics, V 15, No. 3 (08/01/81) at p. 95. This 3-D trackball 

has three sensors which convert ball rotations about three axes 
25 into electrical signals corresponding to three independent 
coordinates, in contrast to a 2-D trackball, which has two 
sensors which convert ball rotations about two axes into 
electrical signals corresponding to two independent coordinates. 
This 3-D trackball is simply a 2-D trackball to which a third 
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5 sensor has been added. The authors remark that the device is 
awkward to use because rotation about the z-axis requires one to 
grip the ball with several fingers in order twist it. 

In the second approach, a sequence of signals from a 2-D 
input device are used to simulate a signal from a virtual 3-D 
10 trackball. An example of such a method is described in U.S. 
patent 5,019,809 to Michael Chen (05/28/91). Using this 
technique, the user must imagine a spherical surface on a circle 
appearing on the screen and manipulate this virtual trackball 
with a physical trackball or mouse. The additional layer of 

15 abstraction separates the user from the sense of directly 

£9 

|0 manipulating the object and compromises accuracy. The patent 
HJ remarks that this is necessitated by the fact that a physical 3-D 
y3 trackball cannot be made with the entire top hemisphere of the 
L/1 ball exposed because of the requirement that a sensor be on the 
2&z equator. Other similar techniques require multiple inputs from 
«j the 2-D input device. The first input defines a reference point 
J or rotation axis. The next input defines the rotation with 
^ : respect to the first input. Several iterations of the two steps 
are sometimes required. This approach can be esoteric and 
25 cumbersome even for design engineers, and is generally not 
attempted by naive computer users. 

A third approach is to supplement the two inputs from a 
standard 2-D input device with a third input from an auxiliary 
electromechanical transducer. U.S. patent 4,933,670 to Nicholas 
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rotating the ball, but it can be useful to think in terms of 
translations when translations are being effected.) In contrast, 
the same rotations and translations must be effected indirectly 
through forces and torques in the Spaceball. These difficulties 
become even more apparent when considering the reversal of such 
a motion. To reverse a motion using a trackball, the velocity- 
time integral (distance travelled) must be reversed. This merely 
requires a user to bring his thumb back to its initial position, 
which can be done easily and accurately. In contrast, to reverse 
a movement using the force-based tracking device, the force-time 
integral (impulse) must be reversed. In a torque-based tracking 
device, the torque-time integral (rotational impulse) must be 
reversed. Integrating these quantities (which can have two or 
three components) with respect to time is neither intuitive nor 
easily quantifiable. Thus, force- and torque-based tracking 
devices present obstacles to the intuitive, accurate, and 
reproducible input of data. 

The article "Tablet-based Valuators that Provide One, Two, 
or Three Degrees of Freedom" by K. B. Evans, et. al. in Computer 
Graphics, V 15, No. 3 (08/01/81) describes the need for 
"kinesthetic correspondence", that is, a direct and natural 
relationship between the hand motions and the corresponding 
rotations about the three axes. The current invention provides 
such a direct and extremely natural correspondence between the 
hand rotating a ball and the rotations about the three axes, and 
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5 C- Wislocki (06/12/90) describes a 2-D trackball supplemented by 
inputs from a third, auxiliary transducer actuated by a rotating 
ring on the top of the ball. This auxiliary ring considerably 
increases the mechanical complexity of the device and obstructs a 
portion of the ball surface. U.S. patent 5,132,672 to Michael R. 

10 Clark (07/21/92) describes a 2-D trackball supplemented by 

inputs from a third auxiliary transducer actuated by a conveyor 
belt or a cylindrical roller. Again, the auxiliary transducer 
adds considerable size and complexity to the device. 
Furthermore, an auxiliary transducer artificially distinguishes 

15^ the third component of input from the other two. Imposing this 
™ distinction upon otherwise comparable components of rotation or 

i : i 
; ~. 

jj^ translation can be confusing and counter-intuitive to the user of 
£ s the device. 

y] ■ A fourth approach is to use force and torque inputs rather 

2£M= than rotations. Tracking devices measuring force and torque are 
fy described in U.S. patent 4,811,608 to John A. Hilton, issued 
■j% (03/14/89) and in the literature describing the "Spaceball" input 
~ device made by Spaceball Technologies, Inc. 

The use of torque and force quantities introduces new 
25 barriers to the intuitive and natural input of data. For 

example, a standard trackball effects rotations on an object in 
the computer by directly rotating the ball. It effects 
translations on an object by directly translating the surface of 
the ball. (Translating the surface is in fact equivalent to 
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5 therefore fulfills this long-felt need. 

Objects and Advantages 

10 

Accordingly, it is an object and advantage of this invention 
to provide an improved trackball device for the input of three- 
dimensional signals into a computer system.. 

It is a further object of this invention to locate the 
15 rotational sensors of this trackball in a hemisphere below an 
y0 equator and to provide a method to transform the signals 
fy corresponding to measured rotations of the ball about arbitrary 
y3 axes into signals corresponding to rotations about Cartesian (x, 
rpi y, and z) axes. 

2TQ It is a further object of this invention to provide tapered 

LTj rollers to these rotational sensors to allow for a compact design 

and allow for sensors for all three rotations to be mounted on a 
^ single planar circuit board. 

It is further object of this invention to use a nonplanar, 
25 saddle-shaped retaining ring and thereby expose a large portion 
of the ball surface such that a ball restricted to a given 
diameter can provide a larger surface area through which the user 
can continuously manipulate it. 

It is a further object of this invention to expose this 



9 




5 large area in adjacent quadrants, such that a user's thumb can 
actuate the ball from a larger range of angles, enabling more 
comfortable use of the trackball, and enabling greater 
flexibility as to the location of the trackball relative to the 
user's hands. 

10 It is a further object of this invention to provide a method 

of transforming the rotations measured about substantially 
arbitrary axes to rotations about the standard Cartesian axes. 

It is a further object of this invention to provide a 
method to quantify the accuracy of these transformed 
15^ measurements. 

It is a further object of this invention to transform 3-D 
jjf rotations into 2-D rotations, so that a 3-D trackball can also 
function as an improved 2-D trackball in order that the single 
y] trackball is compatible with both 2-D and 3-D software. 
2f9^ Furthermore, the transformed 2-D signals from the 3-D trackball 
fU make it functionally equivalent to both the front-mounted and 
=db top-mounted standard 2-D trackball. 

It is a further object of this invention to locate this 
trackball in a portable computer base, so that the front face of 
25 the ball can be adjacent to the front face of the portable 

computer base, and the top face of the ball can be adjacent to 
the top face of the portable computer base. 

It is a further object of this invention to integrate this 
trackball into the front edge of a standard keyboard, so that the 
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5 advantages afforded by this design can be realized without using 
any additional space or adding any new components to the computer 
system relative to commonly known trackballs. 

It is a still further object of this invention in a separate 
embodiment to allow a user to impart rotation about the x- and y- 
10 axes, the x- and z-axes, and the y- and z-axes by translation 

(sliding) exposed z, y, and x faces of the ball. It is a further 
object of this invention to provide this improved trackball using 
a simple design which can be easily and inexpensively 
manufactured and can fit into a compact enclosure. Accordingly, 
15 in this design the three rotational sensors can be of the same 
\0 type, can be of the standard electromechanical type, and can be 
fy located in a nearly arbitrary manner to facilitate ease of 
yg manufacture and compactness. The corrections for the 
[S nonorthogonal measurement directions which result are compensated 
2|Ql by a transformation procedure which can be very inexpensively 
L^t incorporated into the software device driver. 

t: It is a further object to provide a rotational sensor with a 

yj simplified mounting and with reduced rotational friction. 

It is a still further object of this invention to provide 
25 flexibility in the placement and orientation of the rotation 
sensors . 

It is a yet further object of this invention to: 

a) provide an optical method of measuring ball rotation 
in a mouse or trackball; 
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5 b) give very accurate measurements of ball rotations; 

c) allow flexibility in- the location of optical 
rotation sensors; 

d) provide a pattern for very accurate measurement of 
surface motion on a ball; 

10 e) facilitate devices with balls as large as possible 

to allow smoother, more accurate, and more reliable movement 
over rough and dirty surfaces. 

15 This invention enables the intuitive, accurate entering of both 

y3 2-D and 3-D rotation signals through rotation of a single ball. 

m 

fU *t provides a very direct and intuitive manner for entering 3-D 
dj rotations into a computer, namely, by performing those 3-D 
[S rotations on the ball. It enables all of these signals to be 
2»jQ entered by the single thumb of a user. 

Lr; Still further objects and advantages will become apparent 

IT from a consideration of the ensuing description and accompanying 
^ drawings . 

2 5 Summary 

A trackball includes a ball retained in a receptacle by a 
retainer which exposes for manipulation a free area extending 
over an arc greater than 180 degrees over the ball surface. The 
trackball has sensors which generate signals corresponding to the 
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5 rotation about a set of ball axes and a means to generate 

transformed signals corresponding to rotation about a second set 
of axes. A tapered roller on a rotating sensor allows the sensor 
to sense rotations about a ball axis not necessarily parallel to 
the sensor axis. A method is given to generate a transform 

10 signal whose components correspond to rotations about orthogonal 
axes, where the transform signal is based on rotation 
measurements about non-orthogonal axes. A sensor has bearings 
which support a roller shaft at its ends and one of which is 
spring-loaded to maintain frictional contact between the roller 

15 and ball. 

in A method is developed for projecting the regular polygons 

ry from the surface of Platonic solids onto the surface of a sphere, 
-jji These projected shapes provide a regular and very accurate 

\u method to fix the location and the movement of the surface of the 
2^2 ball in a mouse and trackball. A method to divide these polygons 
LI into arbitrarily smaller triangles enables further precision in 
"J measurement. Combining these accurate measurements with a 
^ coordinate transformation method enables the design of a mouse 

and trackball with a more conveniently located that facilitates 
25 a larger and more accurate ball. 

A method and apparatus is described to accurately track the three dimensional 
rotation of the ball in a mouse and trackball using a single optical detector. 
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Brief Description of the Drawing 

Fig. 1 is a perspective view of a preferred embodiment of 
the current trackball invention. 
10 Fig. 2 is an exploded view in partial section of the 

embodiment of claim 1, which shows the location and orientation 
of the measurement sensors and the location of the ball supports. 

Fig. 3a is a perspective view of another preferred 
embodiment of the invention in which the support is tilted 
15 forward and mounted in the front portion of a keyboard. 

%Q Fig. 3b is a perspective view of a variation of the 

fU 

fy embodiment of Fig. 3a in which two areas of the ball are exposed. 
,jj Fig. 4 is a rear view of the embodiment shown in Fig. 3a in 

(n partial section showing the locations of the rollers. 
2^2 Fig. 5 is a side view of the embodiment shown in Fig. 3a in 

*y. partial section showing the manner of contact of a tapered 
ir roller. 

^ Fig. 6 is a detailed top view of an alternate, symmetric 

location of the tapered rollers with the embodiment shown in Fig, 
25 3a. 

Fig. 7a is a detailed front, view of one of the measurement 
sensors, including the tapered roller, shaft, and end bearings. 

Fig. 7b is an enlarged front view of a shaft end bearing of 
the measurement sensor of Fig. 7a. 
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5 Fig. 8 is a side view of an embodiment of the invention 

which includes measurement of force and translation. 

Fig. 9a is a flow chart describing a method of processing 
signals generated by nonorthogonal measurement sensors. 

Fig. 9b is a flow chart detailing a method of processing 
10 signals within a dedicated microprocessor. 

Fig. 9c is a flow chart detailing a method of processing 
signals using a device driver in a computer. 

FIG. 10 a-e shows the five Platonic solids: the tetrahedron, 
the cube, the octahedron, the dodecahedron, and the icosahedron, 
15 respectively. 

yB FIG. 11a shows a mouse using a ball with a surface pattern 

fU formed by an icosahedron with an optical sensor located beside 
yB the ball. 

iff FIG. lib shows a trackball using a ball with 

%Q surface pattern formed by an icosahedron with an optical sensor 
located beside the ball. 

' FIG. 12 shows the pattern projected on to the sensor and the 
UJ velocity components measured. 

FIG. 1 3 shows the hardware and optics that allows a single time-shared motion 

2 5 sensor to track ball motion at multiple points. 

FIG. 1 4 shows a method used to time-share the motion sensor. 
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Description 



10 Referring now to Figs. 1 and 2, the improved trackball may 

be better appreciated. 

A trackball 10 comprises a ball 12, a support 14, a 
retainer 16, three electromechanical sensors 21, 22, and 23, and 
a set of four low-friction pads 26, 28, 30, and 32 attached to 
15 support 14 and to retainer 16. The combination of support 14 and 
pads 26 and 28 form a receptacle which is sized to hold the ball, 
fy The combination of pads 26, 28, 30, and 32 support and contain 
g0 (retain) ball 12 within the support members 14 and 16 of 
Ln trackball 10, and allow rotation of the ball 12 with respect to 
2iGL the trackball 10. A pair of arms 16a and 16b of retainer 16 
j=fi extend over a first hemisphere 12a, across a great circle 12b, 
% and over a second hemisphere 12c'. Trackball 10 can be connected 
^ to a suitably configured port on a computer via a cable and 

connector 34 and can be used in conjunction with standard buttons 
25 in any convenient location. 

Because a free area with an angle of greater than 180 
degrees, such as great circle 13, of the surface of ball 12 is 
available for the user to grasp, the retainer arms 16a and 16b 
may be made sufficiently flexible to enable the user to pull 
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("snap") the ball in and out of position for periodic cleaning. 
This obviates the need for a complex and bulky engagement and 
disengagement mechanism. The retainer arms 16a and 16b should 
also be sufficiently stiff to retain the ball and maintain the 
physical integrity of the ball and trackball under reasonably 
expected shocks and forces imparted to the ball 12 by the user 
during its use. 

The three rollers 21, 22, and 23 frictionally engage ball 
12 and are attached in the standard manner to rotational sensors 
of the standard electro-optomechanical type (not shown) , which 
generate signals that correspond to the degree of rotation of the 
ball 12. 

In conjunction with a computer 23, a software device driver 
24 receives these signals sent by the sensors 21, 22, and 23 via 
connector 34. The software device driver 24 may be a program 
resident in the computer memory which may scale and transform the 
measurements. The software device driver 24, in turn, generates 
a signal that can correspond to translational and/or rotational 
coordinates, or to a cursor position on the screen. The software 
device driver 24 makes these transform signals available to 
programs running on the computer, and may allow these programs to 
switch the transformation of the signals from 3-D to 2-D. 

Low friction pads 26, 28, 30, and 32 support and contain 
ball 12 in the preferred embodiment. Alternately, rollers 21, 
22, and 23 could also support ball 12. However, this introduces 
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5 the design constraint that there must be a single common location 
for both the support member and the rotation sensor. 
Furthermore, a ball supported by frictionally engaged rollers 
tends to align its rotation with the rotation of one of the 
rollers. Once so aligned the static coefficient of friction must 
10 be overcome to break the tractional engagement between the roller 
and ball. In contrast, a pad support introduces no such 
preferential directions. An additional advantage of pads is that 
their compactness allows for great flexibility in locating them 
in a given design. 

15 In describing the rotational axes of ball 12 and the 

&~ 

locations of the other trackball components, it is most useful to 

iy 

fy orient the coordinate system with respect to a stationary frame 

: — : 

~q of reference, rather than with rotating ball 12. Accordingly, 

Q 

Ul in the mutually orthogonal Cartesian axes in Figs. 1 and 2, the 
2[0 z-axis is vertical, the y-axis is aligned parallel to the longer 
it; dimension of the retainer 16, and the x-axis is aligned parallel 
= J to the longer dimension of the housing 14 . The coordinate 
^ origin is at the ball 12 center. In this embodiment, the 

bottom hemisphere of a stationary sphere that coincides with the 
25 surface of the ball 12 (z<0) is defined as a first hemisphere 
12a, the top hemisphere (z>0) as a second hemisphere 12c, and 
the great circle at z=0 as an equator 12b. 

Referring to Fig. 2, in this preferred embodiment roller 21 
is located near the bottom (negative z extreme) of ball 12. Its 
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5 axis of rotation is parallel to ball axis Al (the x-axis) , and it 
rolls along a meridian of ball 10 at x=0, generating a signal 
that corresponds to the rotation of ball 10 about the x-axis. 
Roller 22 is located at a position forward and slightly above 
roller 21. Its axis of rotation is parallel to ballA2 (the y- 
10 axis) , and it rolls along a meridian of ball 10 at y=0, measuring 
the rotation of the ball 12 about the y-axis. However, contrary 
to the comments in U.S. patent 5,019,809, in this invention the^ 
third sensor 23 is not required to be located at the equator 
(z=0), in order to measure the third component of rotation. Its 
15 axis is parallel to the A3, which is not parallel to the z-axis. 
yg The measurement axes Al, A2, and A3 are "nonorthogonal", by 
nj which it is meant that they are not mutually orthogonal, so that 
yg the relative angle between at least one pair of axes is not 90°. 
j~ The rotation of the ball 12 about the orthogonal Cartesian (x-y- 
2[Q z) axes can be determined indirectly from the combination of 

L~ nonorthogonal rotation measurements using a transformation 

f y 

"j! procedure described below. This permits all three sensors to be- 
^ clustered in a region located away from the exposed surface of 

the ball, and thereby allows for a large portion of ball 12 
25 surface to be exposed to the user's fingers for manipulation. 

In typical current art trackballs, the ball is retained in 

the housing by a generally circular and planar retaining ring. 

In order to contain the ball, the diameter of the circular 

retainer must be less than that of the ball and the ball is 
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5 trapped between the ring and the rest of the trackball apparatus . 
Therefore, the exposed portion of the ball is confined within a 
portion of a hemisphere of the ball protruding through the 
retainer, which is less than a full hemisphere. In contrast, the 
current invention uses a nonplanar retainer 16, with which the 
10 exposed area of the ball can extend far beyond the bounds of a 
hemisphere. This allows a greatly increased portion of the 
surface of ball 12 to be exposed. When used in combination with 
three sensors 21, 22, and 23 clustered as described above, this 
extended area can be exposed even in a fully 3-D trackball. 
15 This has several very important new implications. First, 

S the increased solid angle of the sphere exposed enable the ball 
H] 12 of a given diameter to have increased exposed area. Second, 
[a the exposed area can be accessed from a range of angles. Third, 

all three rotations can easily be imparted to the ball by a 
20 single finger of the user. Fourth, the abundant exposed ball 
LH area and the flexibility in sensor location allow this design to 
#= be used in novel configurations and applications. The 
H compactness, simplicity, and ease of manufacture of this design 

should enable it to be routinely included in keyboards and in 
25 laptop computers. 

Another preferred embodiment, which uses a tapered roller, 
is described in Figs. 3-5. Fig. 3a shows a trackball 36 mounted 
in the front edge of a computer component housing such as a 
laptop computer base or a keyboard 38. The top (greater z) and 
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5 front (greater x) surfaces of ball 12 are exposed and the second 
hemisphere is tilted in the x-direction (toward the user) . The 
top of ball 12 is generally flush with or slightly above the top 
surface of keyboard 38, and the front of ball 12 is generally 
flush with the front of keyboard 38. Two arms 16a and 16b retain 

10 ball 12. The arms 16a and 16b may be shaped to smoothly blend in 
with the top and front surfaces of keyboard 38, so that the 
perimeter of the cavity in keyboard 38 through which the ball 12 
protrudes is saddle-shaped. Buttons 42 and 44 are adjacent to 
ball 12 so that they are also easily accessible by the user's 

15 thumbs while typing. Like ball 12, buttons 42 and 44 have 

surfaces oriented to respond to contact from the thumbs from the 
m to Pf front, or from any angle between. 

~J Fig. 3b shows a variation of Fig. 3a in which retainer 16 

rz forms a continuous bridge across the ball and provides two 
2f0 distinct exposed areas of the surface of ball 12. 
HJ The embodiment of Fig. 3a is shown in rear and side section 

=E views in Figs. 4 and 5, respectively. Rollers 46 and 49 and 
ffl tapered roller 48 are all oriented with all three roller axes of 

rotation parallel to a circuit board 50. This simplifies the 
25 manufacture of the design. Fully 3-D rotation signals can be 
produced by these rollers as described below. 

In response to rotation of a body about a given rotation 
axis, a point on the body's surface moves normal to that rotation 
axis. Where the surface of body is symmetric about the rotation 
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5 



axis (such as in a circular cylinder or tapered circular 



cylinder) , that motion is also tangential to th 



e surface. 



Typically a rotation sensor has such an 



axisymme 



trie 



circular cylinder (roller) frictionally engaged with the ball of 
a trackball. The ball contacts the cylinder in a small area 

10 about a contact point. In absence of a surface contour 

discontinuity (such as a cusp) , the tangent planes of the ball 
and cylinder surfaces overlap at the contact point. The roller 
surface is constrained to move in a direction perpendicular to 
its roller axis, and measures ball movement in that direction. 

15 Thus, the roller measures ball rotation on a great circle passing 
through the contact point and whose tangent at the contact point 
pfj is perpendicular to the roller axis. 



hf cylindrical roller 46 responds to rotations about the y-axis. 
2;0 Tapered roller 48 responds to motion of the surface of ball 12 
fU along great circle 51, which passes through contact point 54 and 
4S whose tangent is out of the page and normal to a roller axis 47 
(B of roller 48 at contact point 54. The translational motion of 

the ball surface that is measured at the contact point 54 is in 
25 the y-direction (out of the page) . As seen in Fig 5, contact 
point 54 is located 45 degrees below the center of ball 12 so 
that the great circle 51 is oriented normal to ball axis A3. 
Thus, the motions measured by tapered sensor 48 along great 
circle 51 correspond to ball rotations about ball axis A3. The 



Referring now again to Figs. 4 and 5 



standard 



22 



5 kinematics of such rotating bodies are described in "Kinematics 
and Dynamics of Machines", by G.H. Martin. 

Using the signals from two of the sensors enables 
trackball 36 of Figs. 3-5 to be compatible with standard 2-D 
trackballs of the current art. Rotation signals generated by 
10 sensor 46 correspond directly to rotations about the y-axis of a 
standard trackball. Rotations about either the x or z-axis cause 
tapered sensor 48 to generate signals which can be interpreted as 
rotations about the x-axis of a standard trackball. Thus, both 
2-D components of rotation can be imparted to the rollers by 
15 sliding either the top surface or the front surface of the ball. 
y3 Thus, in contrast to a standard roller, tapered roller 48 

: 

fy is capable of sensing rotations about an axis which is not 

O 

yg parallel to its own axis. In this way, all three rollers 46, 48, 
m and 49 can be mounted parallel to circuit board 50, even though 
2|£1 the rotation measured by roller 48 is about a a ball axis which 
^ is not parallel to circuit board 50. As will be described below, 
IT fully 3-D rotational signals can be generated from the three 
™ sensors, all of which can be mounted parallel to a single circuit 

board using the simple coplanar mounting techniques used in 
25 current 2-D trackballs. The taper is needed because the 

transformation analysis below will show that three nontapered 
rollers whose roller axes were parallel to a single plane result 
in a matrix that could not be inverted (i.e., is singular). The 
novel use of tapered roller 48 to measure a component of ball 
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5 rotation out of the plane of circuit board 50 makes 3-D 

measurements possible using three sensors whose roller axes are 
parallel to a single plane. 

Fig. 6 shows an alternate preferred embodiment with 
tapered rollers. Sensors 56 and 56a are of the same design and 

10 are mounted symmetrically on opposite sides of an x-z plane, so 
that the entire trackball assembly 36 is elongated and mounted 
adjacent to the front edge of keyboard 38. The flexibility 
afforded by the use of the tapered rollers combined with the 
transformation method enables trackball 36 to be laid out in a 

15 compact configuration appropriate for the geometrical constraints 

W of the particular mounting. In this mounting, sensors 56 and 56a 

s y 

[U can fit into a normally unused space beneath and in front of a 
yp spacebar 60 (toward the user) . In current art trackballs, the 
LPf orthogonally mounted sensors preclude such a design. 
210: Referring to both Figs. 6 and 7a, a distal (to the ball) 

f|l end 72 of a spring member 70 of sensor 56 is attached to circuit 
~K board 50. Spring member 70 and a strut 68 provide cantilevered 
" support of bearing 66. Together with bearing 64, these 

components form the shallow "U" configuration of Fig. 7a. 
25 Spring member 70 is of rectangular cross-section, and 

substantially thicker in its z-dimension than in its x-dimension. 

The thicker z-dimension results in spring member 70 being very 
stiff against bending and movement in the z-direction. As a 
result, there is very little tilting of strut 68, and very little 
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5 movement of bearing 66 in the axial (z) direction. Spring member 
70 acts as a rigid clamp which contains shaft 67. 

In contrast, the x-dimension of spring member 70 is 
smaller, which reduces the stiffness against its bending in the 
x-direction. This bending in the x-direction of spring member 70 
10 allows for movement in the x-direction of cantilevered strut 68 
and bearing 66. This flexure in spring member 70 is used to 
apply a radial preload force between roller 62 and ball 12 even 
when ball 12 shifts. The need for a separate spring to apply 
this force is obviated. 
Ill Fig. 7a details sensor 56 with a tapered roller 62. 

^~ Bearings 64 and 66 contain and support both the axial thrust and 
5^ a radial preload force on roller 62. The shaft is of larger 
y3 diameter in its central portion to maintain stiffness and provide 
Ul more area for attachment of roler 62. One end 69 of a shaft 67 
2& detailed in Fig. 7b is typical of the reduced diameter of the 
ry ends of shaft 67 within its supporting bearings 66 and 64 . As a 

result, the frictional force resisting rotation of shaft 67 
TO inside bearings 64 and 66 acts with a lesser moment arm, 

resulting in a lower frictional torque. The cavity in bearing 66 
25 is of slightly larger diameter than the reduced diameter of shaft 
end 69 to enable a tilting between shaft end 69 and the cavity in 
bearing 66 during flexure of spring member 70. 

An additional advantage of a tapered roller such as 
tapered roller 62 is compactness. In current art sensors, the 
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5 roller is usually connected via a shaft to an optical sensing 
wheel of larger diameter. The roller and shaft are parallel to 
the ball surface. Therefore, a long shaft connecting the roller 
and sensing wheel is required to prevent interference between the 
sensing wheel and the ball. In contrast, with tapered rollers, 
10 the shaft generally can point away from the ball. The shaft 

need not be as long to allow the sensing wheel to clear the ball 
surface . 

A last preferred embodiment is illustrated in Fig. 8. 
This embodiment combines the rotation of ball 12 described for 
15 the embodiment of Fig. 1 with a measurement of force and 
y3 translation. Force sensors 80a, 80b, and 80c measure the force 
fU applied to the ball. Mouse ball 82 measures the translation of 
yy the trackball 10. Translation could alternatively be input using 
iff a trackpad or thumbwheel. 

2fi The means by which the various signals generated by the 

fy clustered rollers are processed is now discussed. The object of 
~S this procedure is to convert the signals generated by rollers of 
™ substantially arbitrary orientation into signals corresponding to 

rotations about the standard Cartesian axes. This is 
25 accomplished by first generating influence factors for the 

transformation and second by using these influence factors to 

transform the signals. 

Referring to Fig. 2, rollers 21, 22, and 23 respond to 

rotations Ri, R2, and R3 (components of the vector quantity R x ) 
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5 about first, second, and third ball axes Al, A2, and A3, 

respectively. In the simplest case these ball axes are mutually 
orthogonal and coincide with the x, y, and z (Cartesian) axes. 
In this simple case the rotations correspond simply to the 
rotations R x , R y , and R 2 (components of the vector quantity R x ) . 

10 However, this is not necessary. In fact, as will be shown below, 
all three Cartesian components of rotation can be deduced from a 
set of rotations measured about any three axes that are linearly 
independent (i.e., three axes which are not oriented parallel to 
a single plane) . The rotations from these three linearly 

15 independent ball axes can also be transformed into rotations 
-J3 about any other fourth, fifth, and sixth ball axes. 



y3 will arise due to rotations about each Cartesian axis can be 
Ln directly measured. Equivalently , the rotations can be calculated 
2£ as the direction cosines Cij of each ball axis with respect to 
fij each Cartesian axis (Cij=cosine (aij ) ) - For example, in Fig. 2 the 
angle of ball axis A3 with respect to the z-axis (a3z) is 45 
degrees, so that for the embodiment of Fig. 3, Ci z = cosine (45 
degrees) = 0.707. The resulting equations are: 



The rotational velocities about each roller axis that 
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Ri = Cix Rx + Cly R y + Ciz Rz 



R2 = C 2 x Rx + C 2 y Ry + C 2 z R Z 



R3 = C 3 x Rx + C 3y Ry + C 3z Rz 



27 



5 or, in matrix and vector form, 

Ri = C R x 

However, in the operation of a trackball, the inverse 
10 problem must be solved. In operation, the sensor output signals 
R x are known and are used to generate signals that represent the 
rotation of ball 12 about the Cartesian axes R x . This problem 
can be solved using the inverse of C: 




15 Rx = C" 1 Ri 

ji The inverse of C exists only when the three rows of C are 

hj linearly independent. This corresponds physically to the 

situation where all of three of the sensing axes Al, A2, and A3 
si* which do not share a plane. Measurement errors scale with the a 
2[0 parameter of the matrix c" 1 known as the "stiffness". The 

stiffness is defined as the quotient of the maximum eigenvalue 
+; over the minimum eigenvalue, 

XmaxAmin 

This can be illustrated with two simple examples. 

In the case in which the measuring axes are coincident 
25 with the Cartesian axes, the direction cosine matrix is the 

identity matrix, in which all off-diagonal matrix elements are 
zero: 
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11 0 0| 
C = 10 1 0| 

10 0 11 

10 The inverse of C, C -1 is also the identity matrix, which 

has the eigenvalues [1,1,1], and a resulting stiffness of 1. 

A slightly more complex case is shown in Fig. 2. Ri, R2, 
and R3 are the rotations about axes Al, A2, and A3, 
respectively. Sensor 23 is skewed by an angle of 45 degrees 
15 below the z plane, so that its axis of rotation A3 is in the x-z 
y3 plane, midway between the z and negative x axes. The entries in 

ry 

ry the third column of C are then : 

cos(a3x) = cos(135°) - -0.707 
cos (a3y) = cos ( 90°) = 0 
cos(a3z) = cos( 45°) = 0.707 



I 1 0 0 I 
I 0 1 0 I 
I -.707 0 .707 I 



and its inverse becomes: 



29 





W C 3 y 



rf so that C becomes: 
25 C = 



ii o o | 

c" 1 = 10 1 0| 
|1 0 1.4141 



10 The eigenvalues of C _1 are [1,1/1.414], S o that the 

resulting stiffness is 1.414. The eigenvalues and inverse of the 
matrices may be calculated using standard linear algebra 
procedures, or may be computed using a commercially available 

TM 

matrix package such as Macsyma , available from Macsyma, Inc. of 
15 Arlington, MA. 

ffl This stiffness of the matrix quantifies the sensitivity 

fU of the output of the transformation steps to errors in the input 
yQ signal. In this simple 45 degree skewing case, this can be also 
Lfi be seen by noting that the equation for the x and .y rotations are 
ZB directly measured (R x = Ri; R y = R 2 ) and that R z = Ri + 1.414 R 3 , 
«j so that the signal (and its errors) in measuring R3 are in fact 
T[ amplified by a factor of 1.414 in R z . In view of the fact that 
— typical rotation sensitivities of trackballs are measured in 

thousandths of an inch, this transformation error is not 
25 significant in comparison to that introduced by the human hand. 

The amplification of errors introduced by drag in the rotation of 
the rollers is also be small when the rollers have low-friction 
bearings which introduce little resisting torque to imposed 
rotations and allow the rollers to roll freely. 
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5 If desired, the tendency in some current trackballs for 

the ball rotation to become preferentially aligned with an 
orthogonal roller axis can be reproduced from the signals from 
nonorthogonal signals. For example, a second transformation 
could be applied to the transform signal corresponding to the Rx, 
10 Ry, and Rz rotations. This second transformation may use a rule 
that if Rz is less than 10% of Rx and Rz is less than 10% of Ry, 
set Rz to zero. This allows the user to manipulate x and y 
components data and avoid unintended drift of the z component. 

This transformation method is summarized in the block 
15 diagram of Fig. 9a. Signals Rl, R2, and R3 representing 
y3 rotations about a set of nonorthogonal 'axes are generated from 
fy the sensors in step 90. In step 92 the signals are transformed 
y3 to rotations about a second set of axes which usually are 
[ft mutually orthogonal. This transformation is based on factors 
2il relating the geometrical orientation beween the two sets of axes 
^ as described above. In step 94, new signals corresponding to 
IT the rotations Rx, Ry, and Rz about the second set of axes are 
™ output . 

This procedure can easily be incorporated into the 
25 software device driver 24 in Figs 1 and 9b. It allows the 

rotation sensors to be located at points which can accommodate 
efficient ergonomic design and manuf acturability . The procedure 
has been reduced to a straightforward expression in linear 
algebra, so that it can provide the designer with insight as to 
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the optimal configuration in the design of particular 
embodiments. 

The implementation of this procedure in hardware is 
described in the block diagram of Fig 9b. The three signals 
corresponding to rotation measurements Rl, R2, and R3 are input 
into a dedicated microprocessor 100. The signals are converted 
to digital signals either within the measurement sensors or 
within the signal transformer. The transformations to 
measurement signals corresponding to rotations Rx, Ry, and Rz are 
performed by a microprocessor within the signal transformer 100. 

The signal transformer 100 may be integral with the trackball 
10, so that the output signals produced from the trackball 10 
would mimic those produced from a standard trackball with 
orthogonal sensors. 

An alternate implementation of the transformation 
procedure is described in the block diagram of Fig. 9c. The 
three measurement signals corresponding to rotations Rl, R2, and 
R3 may be first combined and made into digital signals in 
multiplexor 110. A combined signal 112 whose components 
correspond to Rl, R2, and R3 may be passed along through a single 
communications channel. This combined signal 112 is passed into 
the computer 23. Influence coefficients 115 are retrieved from a 
location in memory 114, and the transformation procedure is 
performed on the combined signal 112 to produce the transform 
signals corresponding to rotations Rx, Ry, and Rz. 
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Where 2-D output is desired, the 3-D rotations can be 
reduced to 2-D rotations in several ways. For example, the 
signals corresponding to R x could be used verbatim as a signal 
corresponding to a (2-D) x rotation R X 2d , and the signals 
corresponding to R y and R z could be summed in the software driver 
24 as a signal corresponding to a (2-D) y rotation R y 2d. The 
transformation which reduces 3-D rotations to 2-D would then be: 



Rx2d - C32 Rx 



where 



|10 0 

C32 = 

I 0 .707 .707 



for example. The specific values in C32 can be viewed as scale 
factors and are somewhat adjustable. 

Appropriate adjustment of the influence coefficients 114 
in Fig. 9c enable the trackball 10 to mimic the operation of a 
top-accessible 2-D trackball when the top of ball 12 is 
manipulated, and mimic the operation of a front-accessible 2-D 
trackball when the front of ball 12 is manipulated. 
Alternately, the R y and R z rotation could be combined 



electronically in the signal transformer 100 in Fig. 9b. In a 
third alternative, a single roller such as roller 23 of Fig. 2 
oriented at an intermediate angle between the negative x- and the 
z- axes together with a roller such as roller 22 oriented 
parallel to the y-axis could directly supply these 2-D signals. 

This procedure allows for accurate measurement of 3-D 
rotations of a ball in which the sensors can be located almost 
arbitrarily. This facilitates the design of very compact and 
ergonomic trackballs that can be easily manufactured, such as 
those in the embodiments described above. This procedure 
facilitates the introduction of new and non-standard rotational 
sensors. For example, it may be desirable to use a sensor in 
which the cylindrical roller is tapered for ease of manufacture 
or to increase compactness of the trackball. In this case the 
coefficients in matrix C can be adjusted to reflect the influence 
of each of the rotations R x , R y , and R z on the tapered wheel. In 
fact these coefficients can be determined experimentally after 
manufacture in a calibration procedure by measuring the response 
of each sensor to each of a set of known rotations applied to the 
ball. For example, coefficient Ci y would be the measured 
rotation of sensor 1 in response to a known rotation imposed 
about the y-axis. These measured constants in C can be entered 
into the software device driver 24 with no modifications to the 
electronic or mechanical manufacturing tooling for trackball 10. 
Thus, this procedure gives the ability to compensate for and 
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5 correct hardware design errors through software. One can invest 
in tooling setups for novel and innovative hardware designs for 
which the influence coefficients are not known a priori, and 
measure these coefficients from the actual production trackballs. 
The coefficients can be changed a posteriori without expensive 
10 changes to the tooling setup for the design. 
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DETAILED DESCRIPTION OF FIGS. 10A-E 



PLATONIC SOLIDS 



The Platonics solids are a class of solids which is convex (ball-shaped), has 
vertices which are all alike, and in which each face is a single kind of polygon. There 
are exactly five Platonic solids: the tetrahedron, the cube, the octahedron, the do- 
decahedron, and the icosohedron. 

Each of the eight triangular faces 210 of the octahedron maps onto a re- 
gion covering one-eighth of the sphere surface. The eight sections are bounded and 
separated by three mutually perpendicular planes. Each vertex 212 connects four 
triangles. When these triangles are mapped onto the sphere surface, the corners an- 
gles of each region increases from 60 to 90 degrees. Thus, the isosceles triangles are 
severely distorted in the mapping process. 

Similarly, the four faces of the tetrahedron and eight faces of the cube require 
severe distortion of corner angles to map to a sphere surface. 



The basic icosahedron 220 shown in FIG. lOe has the greatest number of faces 
(20) of the Platonic solids. Each face is an isosceles triangle, and 5 faces meet at each 
of 12 vertices 213 . Each face and each vertex is identical; the solid is completely 
regular and symmetric. 

For a unit circle, the 12 vertices 213 are at the coordinates are listed in Table 

200: 

TABLE 200 



ICOSAHEDRONS 



Coordinates of vertices 213 of an Icosohedron of Radius 1 
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Length of edges = 1.051462 

20 isosceles triangles define the faces 234 of the Icosohedron. For each face 
234, the index of each vertex 213 is listed in Table 202. The order of the vertices 
213 for each face is given in a counter-clockwise orientation as viewed from a point 
external to the icosohedron. 



TABLE 202 

Face Indices of Triangle Vertices 
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PROJECTION 

The triangles on the surface of the icosohedron can be readily mapped onto a 
sphere surface (as in FIG. lib), with little distortion and with the relatively modest 
change in the corner angles from 60 degrees to 72 degrees. 
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The mapping function which projects each point P on the surface of the 
icosahedron to the spherical surface is: 



P x = P x /Radius (0.1) 
P y = Pyl Radius (0.2) 
P z = P z / Radius (0.3) 

(0.4) 

This function maps the line segments 230 on the edges of the triangular faces 
234 to curved line segments lying on the surface of the sphere. 

TRIANGULATION 

FIG. lib shows an icosohedron projected onto the surface of a ball. FIG. 
11a shows an icosahedron whose surface is triangulated to a finer pattern of triangles 
and projected onto the surface of a ball. 

In FIG. 11a, each edge 230 is bisected at a midpoint 232. In a given triangle 
234 the midpoints 232 of the edges 230 are joined a line segment 236 (which will also 
is projected onto the sphere surface). Each isosceles triangular face 234 is split into 
four smaller isosceles triangular faces. Each of the 4 new triangles has a length and 
height 1/2 that of the original triangle. 

The subdivided icosohedron retains a great deal of its regularity. Each of the 
new vertices 232 connect six triangles (as opposed to five for the vertices 213 of the 
icosohedron), so that triangles meet at the new vertices 232 with corners angles of 60 
degrees (as opposed to 72 degrees where five triangles meet at the original vertices 
213). All subsequent divisions create new vertices 232 at which the same number of 
triangles (six) with the same corner angles (60 degrees) meet. 
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This process can be done recursively to subdivide the triangles in a regular, 
well-defined manner for arbitrary number of subdivisions, for an arbitrarily fine mesh. 
An arbitrarily fine mesh is important because in many applications the triangles 
formed must be significantly smaller and more numerous than are available in any of 
the Platonic solids. The resolution of the device requires detection of rotation of the 
ball substantially smaller than the diameter of the ball itself. This is especially true 
if the rotation, rather than translation, is being measured at the detecting area of the 
surface of the ball. 

The coordinates of a new vertex created at the midpoint of two other vertices 
can be calculated as the arithmetic average of the original vertices: 

0 (Pnew)x = ((Pl)x + (P2)x)/2 (Pnew)y = ((Pl)y + (P2)y)/2 (Pnew)z = 
J ((Pl)z + (P2)z)/2 

1 IS? 

~ Once the recursive division process is finished and all of the new vertices 

D are created, the new vertices can be projected directly outward to the surface of the 
* ■ sphere by scaling the values (normalizing the distance vector) so that the final, scaled 

U s radius is 1: 

"i Radius = sqrt(P% + P$ + P 2 2 ) 

D Where the projection operator applied to a point P is: 



P x = P x j Radius (0.5) 
P y = P y / Radius (0.6) 
P z = P z / 'Radius (0.7) 

(0.8) 
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The total number of vertices on the sphere surface for a surface on which 
n subdivisions were performed is 12 x 2 n . Each of the original 12 vertices joins 5 
triangles and is at the intersection of 5 edges. Each of the new vertices formed by the 
subdivision joins 6 triangles and is at the edge of 6 edges. 

The result is a network of vertices distributed in a well-defined, near uniform 
pattern over the sphere surface. The line segments forming the edges of the triangles 
are projected to the surface of the sphere to form great circle routes on the sphere 
surface. The points on the curves that forms the great circle routes are projected to 
the sphere's surface using the projection operator defined above. 

MEASUREMENT 

In one embodiment, the icosohedron is represented by the projections borne 
on the surface of the ball in thin line segments. The intersections of these line segments 
provides a "cross-hair" specification of the location of an intersection point. Given 
the well-defined pattern formed by the Platonic solid, The location of this intersection 
point can be more precisely measured by measurement of the locations of all of the 
line segments converging at the point and extrapolating to the intersection point. 

HYBRID PLATONIC SOLIDS AND OTHER SURFACE PATTERNS 

Hybrid Platonic solids can be constructed by relaxing the constraints. For 
example, by removing the requirement that only one kind of regular polygon be 
used, the family of solids that results we include herein as hybrids within the our 
definition of Platonic solids. These are called the Archimedean Solids (also called the 
semiregular solids), of which there are 13. An example of these solids is the "soccer 
ball" pattern. 

Simplical complexes have a more general surface which is constructed as a 
conglomeration of simplex shapes. For a spherical surface three points define each 
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simplex shape. The patterns generated from simplical complexes may be the line 
segments connecting the sets of three points, or they may be dots at each of the three 
points of each simplex. 

For further detail on Platonic solids the reader is directed to "Polyhedron 
Models" by Magnus J. Wenninger, Cambridge University Press or to "Shapes, Space, 
and Symmetry" by Alan Holden, Columbia University Press. 

DETAILED DESCRIPTION OF THE EMBODIMENTS IN FIGS. 11A and 11B 

FIG. 11a shows a mouse enclosure 240 in which the ball 242 is used to measure 
translation of the mouse across a surface. 

An exposed portion 244 of the ball 242 protrudes through a lower surface 246 
of the mouse housing 240. Within the mouse housing an emitter 248 illuminates the 
surface of the ball and a detector 250 collects light reflected from the pattern in the 
ball surface. 

FIG. lib shows a trackball enclosure 252 which may be a portion of a laptop 
computer. A an exposed portion 254 of a ball 242 protrudes through a top and 
front surface of the trackball enclosure 252. The ball may measure two- or three- 
dimensional rotations imparted to it by a hand. An emitter 248 illuminates the 
surface of the ball 242 and a detector 250 collects light reflected from the pattern 
in the ball surface. The signals from the detector may be transformed to cartesian 
coordinates by the transformation procedure described above. 

MEASURING METHODS 

In the instant invention a device and method of measuring location on the 
two-dimensional surface of a three dimensional object is presented. 

Measuring the position of a three dimensional object can require considerable 
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resources. In order to measure arbitrary positions of the object, resolution is needed 
in each of two directions, and the number of sensing elements needed is the square of 
that needed in each direction. There is a corresponding savings in sensing elements 
needed if the resolution requirements can be reduced. For example, if the required 
resolution in a given direction is reduced by four, the total sensors needed is reduced 
by sixteen. Therefore, there it is highly desirable to extract the maximum amount of 
data from a given resolution. 

Precision can be particularly important when a transformation such as that 
described above is to be applied to the raw measurements. Measurement errors can 
be amplified. This transformation may be used when the design constraints suggest 
that the sensor be located in a position at which it cannot directly measure rotation 
about an axis. 

FIG. 12 shows the image 256 of the pattern projected from the surface of the 
ball 242 onto an optical sensor 250. 

The presence of a known pattern with readily identifiable features aids in 
the triangulation of those features to reproduce the location and orientation of the 
object. 

A pair of spaced measurement points 258 and 260 are chosen. Each has two 
degrees of freedom. Two rotations of the sphere can be measured at each measure- 
ment-point. For the measurement of full three dimensional rotations, both points 
are needed. From these two points 258 and 260, four measurements of translations 
262, 264, 266, and 268 are recorded. There is an extra degree of freedom which is 
unphysical; the recorded two directions of motion cannot have relative motion of the 
two points toward or away from each other. They are a fixed distance apart on the 
sphere. This can be used as a consistency check on the measuring scheme. 
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The regular pattern of the triangular faces makes the exact location of the 
target "cross hairs" , the intersection of lines at polygon corner more exact for a given 
pixel resolution. It ensures a consistent measurement error, and simplifies and makes 
more accurate the pattern recognition needed to accurately locate a point. 

Alternately, the location and orientation of line segments can be measured. 
Aliasing can be applied to further increase the accuracy of detection of the position 
of line segments. Methods to increase the accuracy in determining the location of a 
line segment have been disclosed in US Patent No. 4652765, (1987), entitled "Edge 
detecting device in optical measuring instrument" 

The magnification of the image onto the sensor should be low enough that at 
least one polygon is contained inside the measuring sensor. It should be high enough 
such that there are several pixels per polygon to ensure they can be resolved. 

TRANSFORMATIONS 

The existence of a full pattern element on the screen allows for the measure- 
ment of two points in a spaced relationship. A transformation can be applied to the 
measured rotations to deduce the three-dimensional rotations using the transforma- 
tions described above. As noted above in the section describing the transformation 
procedure, stiffness and the eigenvalues are dependent on the spacing of the points. 
Points separated by 90 degrees arc length on the sphere surface (orthogonal points) 
provide direct measurements of rotations about orthogonal axes. As the spacing 
decreases, the stiffness of the transformation matrix, as measured by the ratio of 
its maximum to minimum eigenvalues, increases. Therefore in measuring rotatations, 
the pair of measurement points should be chosen with the maximum possible spacing. 

The advantage of the fixed, spaced relationship of the cross-hairs for a re- 
peated pattern is that a fixed, predetermined accuracy can be calculated for the 
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transformation to three-dimensional rotations. 
ERRORS IN MEASUREMENT 

Dirt is a significant factor in the long-term reliability of trackballs and mice. 
The regular pattern and the extra degree of freedom provide a method of verification 
of the measurements. Two directions of measurement taken at each of a pair of points 
gives four measurements. Three can be used for the transformation into 3 rotations of 
the ball; the fourth can be used as a verification of the validity of the measurements. 
(The fourth, redundant measured quantity exists because it is not possible for the 
two points, fixed on the ball surface, to move such that they have a component of 
movement directly toward each other). If this happens, measurements from two other 
points are taken. Also the known regular pattern, gives a distance verification. These 
provide fail-safe robustness for a long term reliability of the mouse/trackball. In this 
manner, an irregularity in the pattern due to the existence of dirt or dust would be 
recognized, and a different point or set of points would be alternately be used to get 
a valid measurement. 

EXTENSIONS 

The projection of simplex shapes onto the surface may be replaced by a tiling 
process. In the tiling process, a uniform pattern of tiles (not necessarily polygonal) 
repeats itself over the sphere's surface. A given tile is interchangeable with another 
tile. Example of such patterns appear in the works of M.C. Escher. These may 
give detail finer than the basic polygons at the expense of a more complex pattern 
recognition algorithm. 

The measured quantity of the ball has been discussed in terms of translations 
and rotations. For both translations and rotations, the measurements yield both the 
velocity and the relative location of points on the ball. The measurement system 
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takes sequential "snapshots" of locations of points on the ball surface. The velocity is 
calculated by differentiating the locations with respect to the time interval between 
"snapshots". Thus, the measurement of relative location and velocity is equivalent. 

However, this does not necessarily allow for the measurement of absolute 
location. Platonic solids have equivalent polygons which are tiled on the sphere 
surface. This means that two different polygons can appear to be indistinguishable. 
This can prevent the measurement of absolute locations of the ball. If absolute 
location is needed, the polygons need to be changed to enable a particular polygon 
to be distinguishable from other polygons. 

TIME-SHARING DETECTOR ARRAY 

Referring to FIG. 13, a first area 270a on ball 242 is illuminated when an 
emitter 248a is activated. The light emanating from area 270a travels through the 
optical path 272a and lens 274a to a motion detector 250. 

Referring again to FIG. 13, a second area 270b on ball 242 is illuminated when 
an emitter 248b is activated. The light emanating from area 270b travels through the 
optical path 272b and lens 274b to the motion detector 250. 

The light traveling through optical paths 272a and 272b represent optical 
signals which can be interpreted by the detector 250. Detector 250 includes an array 
of light sensing elements 280 which collectively generate an electrical signal when 
illuminated. Opaque shroud 276 isolates the two light sources from each other to 
prevent cross-talk. 

Referring to FIG. 14, a method for time-sharing the detector 250 is described. 
The three graphs in FIG. 14 show the time histories of how the emitters 248a and 
248b are pulsed. Each emitters alternately pulses on while the other is dark. In this 
way, the detector 250 can distinguish the two signals. The time history of the detector 
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250 shows that it is active when either one of the emitters is active. 

Referring again to FIG. 13, when the surfaces at areas 270a and 270b are 
illuminated, their surface patterns of contrasting reflective properties generates an 
optical signal which is communicated to the detector 250. An electrical signal is 
generated by the detector 250 when it is illuminated by the light signal originating 
from either emitter 248a or 248b. Thus, the detector 250 collects a sequence of 
"snapshot" images from representing the motion at both ball areas 270a and 270b. 

Methods for interpreting a sequence of "shapshot" images of a single area on 
a ball are known in the art. One such method is described in US Patent 5,703,356, 
hereby incorporated by reference. The instant invention allows a single detector 250 
to collect "snapshot" images from two or more areas separated from each other on 
the ball surface. 

The preceeding exercise in eigenvalue analysis of coordinate transformations 
showed that measurements taken at points that are more separated (where the corre- 
sponding rotation axes are more orthogonal and less skewed) result in more accurate 
rotation data. The data collected from separated areas through such a time-sharing 
method allows a single detector 250 with a single set of signal process circuitry to de- 
tect with high accuracy all three components of ball rotation in a mouse or trackball. 

This time-sharing method can represent an improvement over method used 
for the image 256 shown in FIG. 12. In FIG. 12, the spaced measurement points 258 
and 260 are restricted to both lie within a single image 256 representing a single area 
on the ball. Points 258 and 260 therefore are separated by less than the length of the 
area represented by image 256. In contrast, the time-sharing configuration shown in 
FIG. 13 allows the measurement points be lie on two separated areas 270a and 270b. 
The separation between measurement points therefore is not restricted to the length 



47 



« • 



of area 270a or 270b. Herein, the "length" refers to the maximum (diagonal) length 
across an area. 

For clarity and concreteness, the foregoing description contains many specifics. 
However, various other embodiments and ramifications are possible within its scope. 
For example, the light may be infra-red or may be uses any other portion of the 
electromagnetic spectrum. The emitters 248a and 248b may be light emitting diodes. 
The optical paths 272a and 272b may include mirrors, diffraction gratings, and var- 
ious types of lenses. The optical paths 272a and 272b may be merged via prisms, 
semi-transparent mirrors, or simply converge from two directions as described. Thus, 
the scope of the invention should be determined by the the appended claims and their 
equivalents rather than by the examples given. 
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